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Great a 



Pan rama - Microsoft Internet Explorer 



File Edit View Go Favorites 



Your ad here! 



Upload the images you want to use for your panorama 

11a 1lb^ I1c^ ^11d 




Add 
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After the images are upioaded, 
ciicic here! 
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Create Panorama 
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n I I rH~My Computer 



FIG..2A 
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Panorama result - Microsoft Internet Explorer 1 . l| 0 11 X 


file Edit View Go Favorites Help|<:^ - '=^>-Og|l2[IQS0§IH[3l \ { 






Sel\ stuff here! 










Here is your free panoramic image! 
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flg Download Panorama 

Cilcic here to order a fuli resolution glossy print 
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Applicant: John Peterson 

Serial No.: 09/657,949 Filing Date: 09/08/2001 
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"A Server For Merging jnages V 3 form /\ Panoramic Image" 



+ 



Attorney Dc::ket No.: 07844^:18001 



3/9 



I RECEIVE IMAGES OVER NETWORK" 



X 



200 



DETERMINE POSITION OF SEGMENT CORRESPOND- 
ING TO EACH IMAGE RELATIVE TO POSITION OF 
SEGMENTS CORRESPONDING TO OTHER IMAGES 



CORRECT PERSPECTIVE DISTORTION 
IN ALL RELATIVE TO CENTRAL IMAGE 



SET PIXELS OF ALL IMAGES VISIBLE EVERYWHERE 



SET CURRENT IMAGE TO FIRST IMAGE 



SET CURRENT IMAGE TO NEXT AFTER CURRENT 
IMAGE AND REFERENCE IMAGE TO FIRST IMAGE 



202 



204 



206 



208 



210 



DETERMINE OUTLINE OF PANORAMIC IMAGE FORMED BY 

AUGNING THE CURRENT AND REFERENCE IMAGES 
BASED ON THE RELATIVE POSITION OF THE SEGMENT 
CORRESPONDING TO THE CURRENT IMAGE 



1^ 



212 



DETERMINE LINE DIVIDING PANORAMIC OUTLINE (I.E., 
LONGEST LliviE JOJ^^iNG POINl S WHERE BORDERS OF 
CURRENT IMAGE AND REFERENCE \W3E INTERSECT) 



X 



214 



:Ay'.DE PANORAMIC OUTLINE INTO 
T\NO SEC TION S BASED ON LINE 



216 



■218 



DETERMINE WHICH OF THE TWO SECTIONS 
HAS LESS OF THE CURREMT IMAGE THAT IS NOT 
OVEkLAPPED B^.' THE REFERENCE OUTLINE 



X 



SET CURRENT IMAGE TO NOT BE 
INVISIBLE IN THE DETERMINED SECTION 



_ -222 

ANY MORE 
IMAGES AFTER REFERENCE IMAGE^ 
BUT BEFORE CURRENT 
MAGEJ 

NO 



r 



224 



SET 
REFERENCE 
TO NEXT 
IMAGE 
AFTER 
REFERENCE 
IMAGE 



•220 



YES 



DETERMINE MASKING VALUE FOR EACH PIXEL 
OF CURRENT IMAGE BASED ON VISIBLE AREA 
OF IMAGE AND PROXIMITY TO DIVIDING LINES 



226 




OVERLAP IMAGES BASED ON MASKING \i r 
VALUES TO CREATE A PANORAMIC IMAGE I 
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CREATE EMPTY "POSITIONED LIST" STRUCTURE FOR 
STORING IMAGES WHOSE RELATIVE POSITION IS KNOWN 



(done) 




702 



- (from 774 (FIG 5B)) 



YES 



770 



708 



ADD 
UNPOSTIONED 
IMAGE TO 
POSITIONED LIST 



CREATE EMPTY "OVERLAP LIST' FOR STORING IMAGES IN 
POSITIONED LIST THAT OVERLAP THE UNPOSiTIONED IMAGE 



I 



SET 

BEST_CONFIDENCE = 0 
BEST_CONFIDENCE_IMAGE = NO_MATCH 
CURRENTJMAGE = FIRST IMAGE IN POSITIONED LIST 



712 



714 



DETERMINE OFFSET OF UNPOSITIONED 
IMAGE RELATIVE TO CURRENT IMAGE AND 
A CONFIDENCE VALUE FOR THE OFFSET 



CHECK 

iF CONFIDENCE VALUE > A THRESHOLD^ 
VALUE 



716 



in 



726 



SET CURRENT 

IMAGE TO 
NEXT IMAGE 
IN POSITIONED 
LIST 



YES 



718 



ADD CURRENT IMAGE, THE OFFSET AND THE 
CONFIDENCE VALUE TO THE OVERLAP LIST 



CHECK 

IF CONFIDENCE VALUE > BEST 
^CONFIDENCE ? 

^ES° 



720 



NO 



722 



SET 

BEST_CONFIDENCE = CONFIDENCE VALUE 
BEST_CONFIDENCE_IMAGE = CURRENT.IMAGE 



CHECK 

IF CURRENT IMAGE IS LAST IN 
POSITIONED LIST ? 



724 



YES 



z: 



728 



SET REFERENCE 
IMAGE TO FIRST IMAGE 
IN OVERLAP LIST 



^ GO TO 750 (FIG 5B) ) 
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DETERMINE CENTERMOST IMAGE 
BASED ON RELATIVE POSITIONS 



802 



CREATE LIST OF CORRECTED IMAGES THAT 
INCLUDES ONLY THE CENTERMOST IMAGE 



804 



CREATE LIST OF UNCORRECTED IMAGES THAT INCLUDES 
EVERY IMAGE EXCEPT THE CENTERMOST IMAGE 



806 



INITIALIZE BY SERING: 
MAX_OVERLAP_AREA = 0 
SELECTED_WARPEDJMAGE = UNDEFINED 
SELECTED_UNWARPED IMAGE = UNDEFINED 



808 



SET: 

CURRENT_WARPED = FIRST IN IMAGE IN CORRECTED LIST 
CURRENT_UNWARPED = FIRST IMAGE IN UNCORRECTED LIST 



810 



COMPUTE OVERLAP AREA BETWEEN 
CURRENT_WARPED AND CURRENT UNWARPED 



812 




CHANGE SELECTED IMAGES BY SETTING: 
MAX_OVERUP_AREA = OVERLAP AREA 
SELECTED_WARPED_IMAGE = CURRENT WARPED 
SELECTED_UNWARPED_IMAGE = CURRENTUNWARPED 



820 



SET 
CURRENT. 
WARPED = 
NEXT IMAGE 
IN LIST OF 
CORRECTED 
IMAGES 




824 



CORRECTTHE PERSPECTIVE OF SELECTED, 
UNWARPED RELATIVE TO SELECTED_WARPED 
BASED ON THEIR RELATIVE POSITIONS 



r 



830 



SET: 
CURRENT, 
UNWARPED = 
NEXT IMAGE 
IN LIST OF UN- 
CORRECTED 

IMAGES 
CURRENT, 
WARPED = 
FIRST IMAGE 

IN LIST OF 
CORRECTED 
IMAGES 



MOVE CURRENT_UNWARPED IMAGE FROM LIST OF 
UNCORRECTED IMAGES TO LIST OF CORRECTED IMAGES 



FM 



DONE 



J 
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FIG.-7 



+ 



